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Abstract 

Many  personnel  are  assigned  to  different  courses  and  educational  opportunities 
in  the  Turkish  Air  Force  every  year.  This  daunting  process  requires  a  great  deal 
of  time  and  does  not  currently  seek  to  find  an  optimal  solution.  The  Turkish  Air 
Force  has  a  database  for  all  personnel  information,  but  the  officials  use  just  a  few 
quantitative  personnel  data  points  to  complete  their  tasks.  Moreover,  the  matching 
process  is  done  by  hand.  Therefore  there  is  a  need  for  a  model,  which  supports  the 
Decision  Makers,  to  cover  the  some  of  the  other  quantitative  data  points  and  also  add 
some  qualitative  data  for  better  decisions. 

In  this  research,  a  value  model  for  course/education  assignments  is  developed. 
The  multi  criteria  decision  analysis  method,  Value  Focused  Thinking  using  the  Ana¬ 
lytic  Hierarchy  Process  to  determine  value  weights,  is  used  to  develop  the  model;  and 
the  Jonker-Volgenant  Algorithm  for  linear  assignment  problems  is  used  for  the  opti¬ 
mization  phase  of  the  problem.  The  use  of  the  model  is  demonstrated  by  an  example 
and  the  robustness  of  the  model  is  tested  by  post  optimality  analysis. 
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MULTI  CRITERIA  DECISION  SUPPORT  MODEL  FOR 
THE  TURKISH  AIR  FORCE  PERSONNEL 
COURSE/EDUCATION  PLANNING  SYSTEM 

I.  Introduction 

1.1  Background 

’’Genius  without  education  is  like  silver  in  the  mine.”  Benjamin  Franklin 

Personnel  education  is  one  of  the  most  important  subsystems  of  the  human 
resource  management  system  for  both  governmental  and  non-governmental  organiza¬ 
tions.  There  is  nothing  else  like  well  educated  personnel  power.  When  we  look  at  the 
history  we  can  see  that  the  countries,  nations,  militaries  or  any  kind  of  organizations 
which  are  set  up  by  uneducated  people  are  obliged  to  lose.  Education  is  a  lifelong 
process  and  it  is  necessary  for  all  people  in  the  organization.  Most  organizations  focus 
on  strategic  level  personnel  education  more  than  the  others,  because  the  variation  of 
this  level  of  personnel  can  affect  the  whole  organization. 

The  world  is  developing  in  every  area  of  life  including  the  military,  and  despite 
the  changes  of  the  war  environment  and  the  national  security  concept,  the  military  is 
still  so  important  for  all  countries.  The  famous  British  historian  Sir  Michael  Howard 
states  that  the  military  profession  is  the  most  exigent  of  all  the  professions  not  only 
physically  but  intellectually  as  well  (Murray,  2009).  Because  of  the  changes  in  the 
technology  and  in  the  world,  the  new  military  needs  personnel  who  use  their  intclli- 
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gence  more  than  in  the  past.  As  a  conclusion  of  the  new  military  concept,  personnel 
can  deal  with  working  with  different  countries’  personnel,  making  operations  in  di¬ 
verse  cultures  and  nations  (Toffler  and  Toffler,  1993).  The  warfare  is  more  complex 
now  than  it  has  ever  been  hitherto.  Hence,  military  personnel  have  to  be  able  to  think 
analytically  and  always  improve  themselves.  If  you  want  to  reach  your  goal  or  to  be 
successful  in  today’s  competitive  world,  then  you  have  to  show  your  distinction  more 
than  the  others.  Thereby  all  militaries  have  to  make  their  personnel  more  educated 
than  the  others  which  will  make  them  more  powerful.  Recent  United  States  Army 
research  defines  the  nature  of  the  future  officer  as:  ”An  agile,  adaptable,  multi-skilled 
officer  who  leads  in  era  of  complexity  and  global,  persistent  conflict.”  (Barno,  2009). 

Turkey  is  like  a  bridge  between  Europe  and  Asia  which  has  hosted  lots  of  dif¬ 
ferent  civilizations  in  history.  Turkey  is  geographically  close  to  countries  and  regions 
where  lots  of  the  world’s  problems  are  happening  now.  This  unstable  region  makes 
the  Turkish  military  more  important  to  the  country  in  its  history  and  the  Turkish  Air 
Force  (TURAF)  is  one  of  the  most  important  services  of  the  Turkish  Armed  Forces 
(TAF).  For  all  of  the  reasons  mentioned  above  the  TURAF  has  to  be  organized  with 
well  educated  personnel. 

The  TURAF  is  formed  by  different  classes  of  personnel  (e.g.  officers,  NCOs, 
civilians,  specialists,  etc.).  Although  each  class  has  different  career  paths  and  course/e¬ 
ducation  planning  systems,  this  research  focuses  on  the  officer’s  course/education 
planning.  The  officers  are  in  almost  all  of  the  managerial  positions  in  the  TURAF 
as  in  most  of  the  other  Air  Forces.  Thus  the  value  of  an  officer’s  education  level 
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might  affect  the  whole  organization  more  than  the  other  classes  of  personnel.  The 
main  concern  is  going  to  be  able  to  establish  a  helpful  and  effective  decision  support 
model.  You  can  modify  decision  support  models  according  to  your  demands  by  small 
changes.  The  important  thing  is  to  create  the  base  model  and  necessary  algorithm 
to  solve  it.  Although  we  are  going  to  gain  insight  of  the  officer’s  course/education 
planning  system  any  organization  even  TURAF  can  use  it  for  any  class  of  personnel. 

From  this  point  forward,  the  term  course  is  used  instead  of  both  course  and 
educational  facts.  There  are  lots  of  courses  in  the  TURAF  human  resource  man¬ 
agement  system.  Ergo,  to  choose  the  right  personnel  at  the  right  time  to  the  right 
course  while  thinking  about  his/her  career  plan  and  future  positions  is  really  a  hard 
job  for  the  related  TURAF  officials.  The  budget  is  also  another  significant  part  of 
this  system.  There  can  be  changes  in  budget  every  year  which  makes  the  ongoing 
planning  system  more  complex.  Making  all  evaluations  and  calculations  again  and 
again  is  a  time  consuming  process.  The  TURAF,  which  is  a  large  organization,  seeks 
to  find  the  maximum  utilization  of  this  process. 

In  the  TURAF,  this  process  is  managed  by  a  department  beneath  the  Person¬ 
nel  Directorate  in  the  Air  Force  Headquarters.  There  are  also  branches,  which  are 
responsible  for  this  work.  The  platoons  are  not  involved  in  the  selection  process; 
they  only  inform  the  headquarters  of  the  candidate  personnel  if  necessary.  All  the 
workload  for  this  important  and  challenging  process  is  in  hands  of  the  branch  which 
is  called  Individual  Education  Branch.  The  education  is  separated  into  two  sections 
in  this  branch,  in  country  and  abroad.  There  are  no  different  sections  for  personnel 
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specialties  however.  The  courses  that  include  flying  are  done  by  the  Operation  Di¬ 
rectorate.  Because  of  its  different  structure,  the  courses  that  are  just  for  pilots  are 
excluded  from  this  research. 

Currently,  officials  are  evaluating  personnel  according  to  the  relevant  TURAF 
instructions  by  hand.  The  TURAF  assigns  approximately  3000  personnel  to  the 
courses  every  year.  Selection  process  time  changes  with  respect  to  the  course’s  struc¬ 
ture.  When  courses  are  thought  about  for  more  than  one  personnel,  this  planning 
process  takes  approximately  100  working  days  a  year  for  the  planning  officials,  and 
this  time  is  just  for  first  round  elimination  (Koc  and  Erman,  2010).  Eventual  selection 
can  take  more  time  because  of  the  need  to  get  approval  from  the  other  Directorates. 
This  research  is  interested  in  just  the  time  for  the  first  round  selection  process. 

This  is  a  multi  criteria  assignment  problem  with  a  budget  constraint.  Conduct¬ 
ing  this  process  by  manual  assessments  is  daunting.  The  multi  criteria  optimization 
techniques  make  it  easier  and  reduce  the  working  hours  spent  for  a  manual  solution. 

1.2  Research  Objectives,  Assumptions,  and  Questions 

The  motivation  of  this  research  comes  from  the  multi  criteria  assignment  prob¬ 
lem  of  the  TURAF  course/education  planning  system.  Creating  a  new  decision  sup¬ 
port  model  and  finding  the  optimum  personnel  matches  by  taking  into  account  the 
budget  constraint  is  important  for  the  TURAF.  Using  this  model  the  manpower  and 
budget  will  be  used  more  efficiently  and  effectively.  At  present,  assigning  the  per- 
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sonnel  to  the  courses  is  executed  manually  and  takes  lots  of  time.  We  can  show  the 
difficulty  of  this  problem  with  an  example: 

Given  15  personnel  and  5  different  courses  and  assuming  all  the  personnel  are 
eligible  for  all  the  courses,  we  have  (15!  /  (15-5)!)  or  360,360  different  matches.  It  is 
impossible  for  a  human  alone  to  review  all  these  possible  matches. 

With  this  model  both  the  working  hours  of  detailers  and  the  effectiveness  of 
results  will  be  improved.  Hence,  the  main  goals  of  this  research  are  to  build  and 
validate  a  multi  criteria  decision  support  model  for  decreasing  the  official’s  effort  and 
maximize  the  utilization  of  results  with  respect  to  the  benefit/cost  ratio. 

In  this  research,  Value  Focused  Thinking (VFT)  is  used  for  both  in  approach 
to  decision  making  process  and  evaluation  of  alternatives.  This  research  builds  a 
value  hierarchy,  which  determines  scores  for  both  personnel  and  courses.  It  uses  the 
weights  of  the  measures  of  the  value  hierarchy.  The  weights  of  the  measures  in  the 
value  hierarchy  are  found  by  using  the  Analytic  Hierarchy  Process  (AHP).  It  will  have 
qualitative  and  quantitative  factors  together  in  the  overall  objective.  This  method  is 
effective  for  complicated  and  unorganized  decisions  (Korkmaz  et  al.,  2008). 

The  value  hierarchy  is  built  according  to  the  TURAF  Instruction  with  the  help 
of  subject  matter  of  experts  (SME).  The  value  hierarchy  is  mutually  exclusive  and 
completely  exhaustive.  Personnel  and  course  information  can  be  found  in  databases 
of  the  organizations.  The  TURAF  has  a  database  for  personnel  information  yet  not 
the  same  thing  for  courses.  Although  there  are  too  many  courses,  each  course  has 
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requirements  in  official  documents.  To  build  a  database  of  courses  is  just  a  one  time 
job  and  can  be  done  easily.  It  is  assumed  that  the  TURAF  can  develop  such  a 
database. 

In  the  current  situation  matches  depend  on  the  TURAF  Instruction.  The  main 
concerns  are  to  not  violate  the  instructions  and  find  the  best  personnel  by  looking 
at  his/her  information  and  requirements  of  the  course.  However,  there  is  currently 
no  quantitative  approach  in  the  process.  There  are  some  quantitative  details  used 
but  they  are  evaluated  qualitatively.  This  research  develops  a  quantitative  analysis 
process  that  uses  scores  for  both  personnel  and  courses.  In  this  manner  it  will  find 
the  value  of  a  match  that  is  going  to  give  the  most  benefit  for  the  TURAF. 

As  we  mentioned  before  cost  is  also  important  for  this  problem.  Therefore, 
this  method  will  find  the  benefit/cost  ratio  for  the  match.  This  number  is  used  as 
the  weight  for  a  bipartite  matching  algorithm.  This  will  give  the  best  match  for  the 
TURAF  including  the  consideration  of  cost.  For  the  decision  support  model  to  be 
effective  and  efficient,  it  must  be  able  enhance  the  value  of  matches  and  reduce  the 
working  hours  spent  to  find  good  matches  in  the  current  position. 

This  research  makes  the  following  assumptions  with  respect  to  the  given  prob¬ 
lem: 

(a)  For  at  least  one  course,  there  is  an  intersection  among  the  personnel’s  course 

domain,  which  is  a  all  set  of  courses  for  a  given  personnel,  in  a  course  pool. 

(b)  Personnel  may  be  eligible  for  more  than  one  course  at  a  time. 
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(c)  Exceptional  situations  (classified  courses,  special  branches,  etc.)  are  excluded 
from  the  scope  of  this  research. 

(d)  Because  of  the  privacy  of  the  personnel  data,  random  numbers  are  going  to  be 
used  instead  of  actual  data.  The  random  data  is  well  suited  and  there  is  no 
need  to  validate  the  data. 

(e)  Random  data  is  also  used  for  the  cost  of  a  course.  The  cost  is  same  for  all 
personnel  who  can  be  assigned  to  given  course. 

(f)  Any  course  may  be  canceled  from  the  assignment  pool. 

The  Research  Question: 

Is  there  any  way  to  build  a  robust,  effective  and  efficient  decision  support  model 
(DSM)  which  provides  maximum  utilization  of  the  course/education  planning  system 
for  the  TURAF;  includes  the  cost  of  a  course;  and  reduces  the  number  of  hours  worked 
by  officials  when  accomplishing  their  tasks? 

There  are  some  other  questions  related  to  the  main  research  question,  such  as: 

•  Why  is  it  necessary  to  establish  a  decision  support  model? 

•  What  are  the  shortcomings  of  the  current  system? 

•  How  much  time  will  be  saved  by  using  this  model? 

•  Can  the  model  improve  effectiveness  of  the  planning  system? 

•  Which  criteria  can  be  used  for  the  model? 
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•  What  can  be  added  to  the  TURAF  Instruction  for  making  the  model  more 
useful? 

1 . 3  Organization 

Chapter  2  details  multi  criteria  decision  analysis  and  decision  support  models. 
Furthermore  it  discusses  methods  for  solving  multi  criteria  decision  analysis  problems. 
Chapter  3  describes  the  methodology  used  to  solve  the  assignment  matching  problem 
with  the  verification  of  the  matching  algorithm.  Chapter  4  describes  the  application  of 
the  methodology  to  both  small  and  large  scale  problems.  Chapter  5  states  conclusions 


of  the  research  and  future  work. 


II.  Literature  Review 


This  section  explains  foundations  and  different  methods  of  multi  criteria  decision 
analysis  problems.  First  is  a  general  background  of  multi  criteria  decision  making 
problems,  then  assignment  problems  and  finally  decision  support  models. 

2.1  Background 

Decision  Analysis  (DA)  is  one  of  the  most  important  subjects  of  the  Operations 
Research  (OR)  community.  Most  DA  problems  have  conflicting  objectives;  so  deci¬ 
sion  makers  have  to  make  a  decision  in  challenging  situations  which  makes  DA  very 
important. 

Multi  Criteria  Decision  Analysis  (MCDA)  methods  are  applied  to  provide  an 
analytical  approach  for  compounding  risk  levels,  values,  and  uncertainty  and  provide 
evaluation  and  ranking  of  many  alternatives  (Linkov  and  Steevens,  2010).  MCDA 
is  an  inclusive,  organized  process  for  selecting  the  best  or  optimal  alternative  among 
the  many  alternatives.  The  acronyms,  MADM  (Multiple  Attribute  Decision  Making), 
MODS  (Multi  Objective  Decision  Support),  and  MCDM  (Multiple  Criteria  Decision 
Making)  also  are  used  for  MCDA  (Hajkowicz  et  al.,  2000). 

Hajkowicz  and  Higgins  (2006)  define  the  basic  steps  of  the  MCDA  process  as: 

(a)  Choose  decision  alternatives. 

(b)  Choose  evaluation  criteria. 

(c)  Create  evaluation  matrix  based  on  performance  measures. 
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(d)  Transform  into  commensurate  units. 

(e)  Weight  the  criteria. 

(f)  Rank  the  alternatives. 

(g)  Perform  a  sensitivity  analysis  if  necessary. 

(h)  Make  a  decision. 

In  sensitivity  or  post  optimality  analysis,  the  variation  of  the  results  according 
to  changes  in  the  values  or  weights  are  examined  (Janssen,  1992). 

In  MCDA,  most  of  the  methods  have  a  similar  approach  to  the  decision  making 
process;  however  they  evaluate  the  alternatives  in  different  ways.  Different  methods 
need  different  types  of  information  and  use  various  algorithms  to  find  the  optimal 
solution.  The  aim  of  MCDA  methods  is  to  reduce  the  complexity  of  the  problem  and 
help  the  decision  maker  (DM)  make  a  decision  which  depends  on  his/her  measures. 
An  MCDA  model  needs  at  least  two  non  dominated  decision  options. 

Hipel  (1992)  describes  the  MCDA  as: 


/ 

ar,i 


X  = 


y%l,m 


\ 

%n,l 


n: decision  options  m: criteria 


Figure  2.1:  MCDA  Model  Representation 
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This  mxn  matrix  is  called  an  effects  table  with  m  criteria  and  n  alternatives. 


There  is  also  a  corresponding  weight  vector  which  shows  the  importance  of  each 
criteria.  Hajkowicz  et  al.  (2000)  states  the  strengths  and  weakness  of  MCDA  are  as 
follows: 

Strengths: 

•  Many  methods  can  use  both  qualitative  and  quantitative  data  in  any  measure¬ 
ment  units  other  than  monetary. 

•  DMs  find  it  logical  because  they  already  follow  that  process  inadvertently. 

•  It  establishes  a  good  framework  for  problems  that  contain  large  and  complex 
data,  and  this  framework  also  improves  the  DM’s  understanding  of  a  problem. 

•  It  uses  DM’s  values  for  weights  and  standardization  which  makes  the  process 
more  obvious. 

•  It  allows  an  interaction  between  DM  and  a  model. 

•  Sensitivity  analysis  is  available  for  MCDA. 

•  DMs  can  specify  the  level  of  complexity  of  the  problem. 

Weaknesses: 

•  Sometimes  determination  of  weights  is  not  understood  by  DM.  This  can  cause 
a  problem  because  the  weights  affect  the  results  strongly. 

•  There  are  lots  of  MCDA  methods  and  there  is  no  clear  guidance  about  choosing 
the  methods.  Different  methods  may  conclude  in  different  results. 
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•  Some  of  the  MCDA  methods  are  so  complex  that  can  actually  reduce  the  DMs 
understanding  of  the  problem. 

•  Some  methods  need  lots  of  inputs  from  DM  and  that  can  cause  a  time  problem. 

•  Methods  for  compounding  time  into  MCDA  are  still  in  process  of  development. 
We  have  to  know  the  effect  of  time  on  our  alternatives. 

The  assignment  matching  problem  is  one  of  the  optimization  problems  in  the 
area  of  OR.  For  big  organizations  the  assignment  process  can  be  a  confusing  and  time 
consuming  subject.  The  assignment  matching  problem  is  the  problem  of  selecting  an 
optimal  assignment  of  m  elements  (e.g.,  people  or  machine)  to  n  positions  (e.g.,  jobs 
or  tasks),  assuming  that  numerical  values  are  given  for  each  element’s  performance 
on  each  position.  An  optimal  assignment  is  the  one  that  maximize  the  sum  of  the 
element’s  values  for  their  assigned  positions  for  a  given  set  of  constraints  (Munkres, 
1957).  The  formulation  of  the  personnel-assignment  matching  problem  can  be  written 
as  follow  (Gass,  1985): 


m  n 


(2.1) 


subject  to 


n 


i  =  1,  2, ...,  m 


(2.2) 


m 


j  =  1,2,. ..,71 


(2.3) 


xi:j  >0  \/i,j 

Model  1:  Personnel  Assignment  Problem  Formulation 
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Xij  =  1  if  individual  i  is  assigned  to  position  j,  0  otherwise. 

Cij  =  The  value  of  assigning  i  to  j. 

Here  the  objective  (2.1)  is  maximizing  of  the  total  value  of  assigning  i  to  j. 
Constraint  (2.2)  denotes  that  individual  i  must  only  fill  one  job  and  constraint  (2.3) 
denotes  that  position  j  must  be  filled  by  one  individual  i.  Due  to  the  structure  of  the 
problem  integer  values  are  going  to  be  had  for  all  the  basic  feasible  solutions  (Gass, 
1985).  In  this  research,  constraint  (2.2)  and  (2.3)  have  to  have  less  than  or  equal 
to  sign  instead  of  equality,  because  every  individual  does  not  need  to  fill  one  of  the 
positions,  and  there  is  no  obligation  for  filling  the  all  positions  in  the  TURAF  problem. 

Individuals- Vj  Alternatives- V2 


Figure  2.2:  Bipartite  Graph  Representation 

The  personnel-assignment  matching  problem  can  be  visualized  by  a  bipartite 
graph  with  a  set  of  disjoint  vertices  and  edges.  G  =  (Vi ,f^,f?),  where  the  set  of 
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vertices  are  disjoint  such  that  V  =  (Vi  U  V2)  and  every  edge  E  has  one  end  point 
in  Vi  and  the  other  end  point  in  V2  (Wolsey,  1998).  A  representation  of  a  bipartite 
graph  can  be  seen  in  Figure  2.2.  In  this  graph  Vj  represents  a  set  of  individuals  and 
V2  represents  a  set  of  positions  and  edges  represent  potential  assignments  with  cost 
or  weight  (ctJ)  of  assigning  an  individual  i  to  position  j .  There  is  no  matching  of 
individual  to  individual  or  position  to  position. 


The  most  common  way  of  formulating  the  bipartite  assignment  matching  prob¬ 
lem  is  as  follows  (Goemans,  2010): 


ma  x(ormin)  EE  Cij  Xij 

i=l  j= 1 

subject  to 

n 

=  1  i  G  Vi  —  1, 2, ...,  m 

3= 1 
m 

^2 =  1  ieV2  =  l,2,...,n 

3= 1 

>0  Vi,  j 

Model  2:  Bipartite  Assignment  Matching  Problem  Formulation 


(2.4) 


(2.5) 

(2.6) 


The  goal  is  to  maximize  the  number  of  matches  of  individuals  to  positions  while 
meeting  the  constraints  that  an  individual  must  only  £11  one  position  (2.5)  and  a 
position  must  be  filled  by  just  one  individual  (2.6).  As  stated  in  personnel  assignment 
problem  formulation,  again  constraint  (2.5)  and  (2.6)  have  to  have  less  than  or  equal 
to  sign  due  to  the  scope  of  this  research. 
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With  the  evolution  in  computer  technologies,  DSMs  and  their  applications  have 
developed  significantly.  Because  of  the  increase  in  the  number  of  large  organizations 
and  globalization,  decisions  have  become  more  complex,  thereupon  every  area  of  life 
has  started  to  need  decision  support  more  than  in  the  past. 

”MCDM  research  in  the  1970s  focused  on  the  theoretical  foundations  of  multi¬ 
ple  objective  mathematical  programming  and  on  procedures  and  algorithms  for  solving 
multiple  objective  mathematical  programming  problems  During  the  1980s,  emphasis 
shifted  toward  the  implementation  of  MCDM  models  on  computers  with  the  aid  of  de¬ 
cision  support  systems. . .  Characteristics  of  multiple  criteria  decision  support  systems 
that  are  often  absent  from  other  types  of  decision  support  systems  include  analysis  of 
multiple  criteria,  involvement  of  MCDM  methods,  and  the  integration  of  user  input 
in  the  modeling  processes. . .  ”  (Dyer  et  al.,  1992). 

A  DSM  allows  an  interaction  between  the  data  and  DM.  Therefore  a  DSM 
must  be  user  friendly.  Technological  innovations  have  also  affected  DSMs  over  time. 
Initially  DSMs  were  started  to  help  individual  DMs  but  later  were  implemented  for 
group  decisions  (Shim  et  all.,  2002). 

Especially  for  large  scale  and  multi  criteria  problems,  decision  support  is  impor¬ 
tant  because  of  the  complexity  of  the  problem.  Nowadays  most  of  the  organizations 
are  using  computers  in  their  jobs  and  that  makes  databases  more  accessible.  Hence 
by  using  decision  support  models  we  can  achieve  satisfying  results  more  easily. 
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Figure  2.3:  Decision  Support  System  Components  (Sprague  and  Carlson,  1982) 

Power  and  Sharda  (2007)  classify  decision  support  systems  (DSS)  according  to 
their  structures. 

•  Communications-driven. 

•  Data-driven. 

•  Document-driven. 

•  Knowledge-driven. 

•  Model-driven. 

The  meaning  of  these  systems  can  also  be  seen  by  their  names.  A  Communications- 
driven  DSS  is  one  that  is  driven  from  communications  and  information  technologies. 

A  Data-driven  DSS  is  driven  from  data,  managerial  reports  or  analysis.  A  Document- 
driven  DSS  integrates  a  variety  of  storage  and  processing  technologies  to  supply  com¬ 
plicated  document  retrieval  and  analysis  to  support  the  DM.  A  Knowledge-driven 
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DSS  is  based  upon  knowledge  that  has  been  kept  by  using  artificial  intelligence  or 
statistical  tools.  A  Model-driven  DSS  includes  computerized  systems  and  also  use 
optimization  models  to  help  the  DM.  It  is  interested  in  the  manipulation  of  a  quanti¬ 
tative  model  and  so  the  model  is  the  superior  component  in  the  DSS  that  renders  the 
functionality  for  the  DSS.  This  research  uses  a  model-driven  DSS.  The  model  is  going 
to  be  structured  according  to  the  multi  criteria  hierarchy.  An  optimization  model  is 
also  going  to  be  used  in  the  model-driven  DSS. 

2.2  Multi  Criteria  Decision  Analysis  Methods 

Multi  Criteria  Analysis  is  a  process  that  uses  weighted  criteria  to  rank  alterna¬ 
tives.  MCDA  determines  the  desirability  of  one  alternative  over  the  others  according 
to  criteria.  In  other  words  it  tries  to  assist  the  DM  with  the  problem  according  to 
his/her  preferences  and  desires. 

Howard  (1991)  states  that  methods  for  multi  criteria  decision  analysis  are  proce¬ 
dures  and  mathematical  algorithms  for  aiding  decision  making  when  multi  criteria  are 
considered.  There  are  approximately  45  different  MCDA  methods  (Nijkamp,  1989). 
Therefore,  choosing  the  method  can  be  important  to  achieve  better  conclusions. 

MCDA  methods  are  commonly  grouped  as  discrete  or  continuous  methods  (Janssen, 
1992).  Discrete  methods  try  to  identify  the  most  desirable  alternative  from  a  finite 
set  of  alternatives.  On  the  other  hand  continuous  methods  try  to  identify  an  optimal 
alternative  from  an  infinite  number  of  feasible  alternatives  (Hajkowicz  et  al.,  2000). 
Beside  the  discrete  and  continuous  methods  there  are  lots  of  different  ideas  about 
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subdividing  the  methods  further.  Discrete  methods  are  suitable  for  this  researches 
model.  Seo  and  Sakawa  (1988)  classify  discrete  MCDA  methods  as  analytical  or  judg¬ 
mental  methods.  Janssen  (1992)  divides  them  into  qualitative,  quantitative  or  mixed 
methods. 


_ _ 

•  Multi  Attribute  Value  Theory 
•Multi  Attribute  Utility  Theory 

•  Discordance  Analysis 

•  Weighted  Summation 

•  Regime  Method 

•  ELECTRE  Method 
•PROMETHEE  Method 


_ 2K _ 

•  Concordance  Analysis 

•  Lexicographic  Ordering 

•  Linear  Assignment 

•  Frequency  Method 


_ _ _ X _ 

•  Evamix 

•  Cardinalisation  of  Evaluation 
Matrix 

•  Value  Focused  Thinking 

•  Analytic  Hierarchy  Process 


Figure  2.4:  MCDA  Methods  Classification  (Hajkowicz  et  al.,  2000) 


Hajkowicz  et  al.  (2000)  classify  discrete  methods  based  on  function  (Figure  2.4). 
Weighting  the  criteria,  standardizing  data  values  in  the  effects  table  and  ranking  the 
alternatives  are  determined  as  functions  of  MCDA.  According  to  Seo  and  Sakawa 
(1988)  the  classification  of  analytic  methods  are  shown  in  normal  print  and  judgmental 
methods  are  shown  in  italics  in  Figure  2.4. 
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2.2.1  Goal  Programming.  Many  of  the  MCDA  subjects  are  optimiza¬ 
tion  related  and  goal  programming  is  one  of  the  most  common  techniques.  The  pros 
of  goal  programming  is  that  these  goals  can  be  weighted  according  to  DM  preferences 
or  some  mathematical  system  (Lee  and  Schniederjans,  1983).  ft  is  typically  used 
for  assignment  problems  such  as  personnel  assignment  in  military  as  in  the  research 
of  Cirnen  (2001). 

The  mathematical  formulation  of  goal  programming  is  described  as  follows 
by  Ananda  and  Herath  (2009): 

n 

Min  z  =  Pid~  +  Pidj  (2.7) 

1=1 

subject  to 

n 

'akjXj<bk  k  —  1,  2, ...,  s;  %  —  1,  2, ...,  n  (2.8) 

i= i 

n 

's^yiijXj  +  d~dj  =  gi  i  =  l,2,...,ra  (2.9) 

3— ! 

Xj,d~,df>  0  Vi,  j 

Model  3:  Goal  Programming  Formulation 

Here  Xj  is  the  decision  variable,  P,;  is  a  weighting  function,  dj  is  the  under 
achievement  of  the  goal,  df  is  the  over  achievement  of  the  goal,  a ^  is  the  input- 
output  coefficient  between  model  constraint  k  and  activity  j,  bk  is  a  model  constraint, 
f Xj  is  the  input-output  coefficient  between  goal  constraint  i  and  activity  j  and  ()t  is  a 
goal  constraint.  (2.7)  is  the  function  for  minimizing  the  sum  of  weighted  deviations 
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from  the  goal,  (2.8)  is  the  constraint  equation  for  the  model  and  (2.9)  is  the  equation 


for  the  goal  constraints. 


2. 2. 2  Weighted  Summation.  It  is  one  of  the  most  simple  and  commonly 
used  methods  of  MCDA.  In  this  method  the  criteria  weights  are  multiplied  with  the 
standardized  performance  measures  to  obtain  a  value  score.  Therefore,  the  first  step  in 
the  weighted  summation  method  is  standardizing  the  data.  Two  ways  to  standardize 
the  decision  variables  are  shown  below  (Ananda  and  Herath,  2009). 


Xjj  -  mmj(xij) 
ma  Xj(xij)  —  min^ay,) 

rna Xj(xjj)  —  Xij 

ma  x.j(xij)  —  m.m.j{xij) 


(2.10) 

(2.11) 


Here  Sij  is  the  standardized  performance  measure  of  the  ith  alternative  against 
the  jth  criteria,  Xij  is  the  performance  measure  for  the  ith  alternative  against  the  jth 
criteria,  min j(xij)  is  the  minimum  performance  measure  for  all  alternatives  against  the 
jth  criteria  and  rnaxj  {xl3 )  is  the  maximum  performance  measure  for  all  alternatives 
against  the  jth  criteria.  Equation  (2.10)  is  for  a  criterion  where  more  is  better  and 
Equation  (2.11)  is  for  criteria  where  more  is  worse. 

An  overall  performance  score  is  obtained  for  each  alternative  using  the  following 
formula  (Ha.jkowicz  et  al.,  2000): 


m 

Vi  Y^SiiWi  (2.12) 

2—1 
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Equation  (2.12)  is  the  overall  performance  of  alternative  i,  and  Wj  is  the  weight  of 
criteria  j.  It  is  seen  from  the  formulation  that  the  weighted  summation  method  can  be 
used  only  when  the  weights  information  of  data  is  available.  Although  commonly  used, 
the  weighted  summation  method  makes  some  assumptions  about  the  decision  problem, 
which  can  cause  inaccurate  results.  The  assumptions  of  the  weighted  summation 
method  are  as  follows  (Rowe  and  Pierce,  1982): 

•  Value  function  for  criteria  must  be  linear. 

•  Criteria  value  functions  must  be  on  cardinal  scales. 

•  Weights  must  be  on  a  ratio  scale. 

•  Each  weight  must  represent  the  relative  importance  of  a  unit  change  in  the  value 
function. 

•  There  must  be  additive  independence  among  the  preferences. 

However  this  method  has  some  shortcomings.  Sometimes  the  objective  function 
may  be  multiplicative  instead  of  additive.  The  criteria  transformation  can  be  non¬ 
linear;  often  concave  and  convex  forms  more  accurately  capture  DM  preferences  (Ha- 
jkowicz  and  Higgins,  2006). 

2.2.3  Multi- Attribute  Utility  Theory.  Multi- Attribute  Utility  Theory 
(MAUT)  focuses  on  the  alternatives  on  the  side  of  risk  and  uncertainty.  MAUT  is 
based  on  the  use  of  utility  functions.  Utility  functions  transform  the  values  of  the 
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alternatives  into  a  dimensionless  scale  and  therefore  the  more  preferred  alternative 
gets  a  higher  utility  value  (Fulop,  2005). 

In  MAUT  every  criteria  must  be  evaluated  independently  of  the  others  and 
different  overall  functions  can  be  used  depending  on  the  preferential  independence 
assumptions  (Seo  and  Sakawa,  1988).  Keeney  and  Raiffa  (1976,  citied  in  Ananda  and 
Heratli,  2009)  described  the  ways  to  check  for  utility  independence  as  follows: 


U(Yu...1Yn)  =  Y,kiUi{Yi)  (2.13) 

i— 1 
n 

1  +  KU(YU  ...,  Yn)  =  JJ[1  +  KhUiiY,)}  (2.14) 

i= 1 

Equation  (2.13)  is  for  an  additive  function  and  Equation  (2.14)  is  for  a  multi¬ 
plicative  function.  Here  U  and  U{  are  utility  functions  scaled  from  zero  to  one,  the 
ki  is  a  scaling  constant  with  0  <  /q  <  1,  and  K  >  —1  is  a  non-zero  scaling  con¬ 
stant.  If  a  utility  function  is  additive  then  J0"=i  ki  —  1,  and  if  it  is  multiplicative  then 

EIL,  ki^i. 

Even  though  these  functions  are  generally  believed  to  a  provide  better  foun¬ 
dation  of  DM’s  preferences  and  demands,  they  are  not  often  used  because  of  the 
computational  problems  and  long  assessment  time  (Janssen,  1992). 

2.2. 4  ELECTRE  Method.  ELECTRE  (Elimination  and  Choice  Ex¬ 
pressing  Reality)  method  was  defined  by  Bernard  Roy  in  1968  and  is  commonly  used 
in  French  countries  (Collette  and  Siarry,  2003).  Ananda  and  Herath  (2009)  state  that 
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this  method  shows  the  characteristics  of  the  DM’s  preferences  by  pairwise  concor¬ 
dance  and  discordance  tables  calculated  for  each  criterion.  The  main  idea  is  to  find 
out  the  degree  to  which  the  scores  and  their  associated  weights  affirm  or  oppose  the 
dominant  pairwise  relationship  among  alternatives  (Janssen,  1992). 

The  concordance  index  shows  how  much  alternative  a  is  better  than  alternative 
b  with  respect  to  the  ith  criteria.  On  the  other  hand  the  discordance  index  shows  that 
how  much  alternative  a  is  worse  than  alternative  b  with  respect  to  the  ith  criteria. 
Both  concordance  and  discordance  indices  lay  between  zero  and  one. 

The  concordance  and  discordance  indices  are  defined  by  Ananda  and  Herath 
(2009)  as  follows: 


c(a,  b)  = 


Sum  of  weights  for  criteria  where  a  >  b  J2keA(a,b)  wk 


Sum  of  weights  for  all  criteria 


T,kwh 


(2.15) 


Maximum  interval  where  b  >  a  Z(b,  k)  —  Z(a,  k)  . 

d{a ,  b)  = - - - - - - - - - =  max k - — -  (2.16) 

Largest  range  of  scale  k* 


Equation  (2.15)  is  for  the  concordance  index  and  Equation  (2.16)  is  for  the  dis¬ 
cordance  index.  Here  w(k)  is  the  weight  assigned  to  criteria  k,  Z(b,  k )  is  the  evaluation 
of  alternative  b  with  respect  to  criteria  k,  A(a,  b)  =  k\\  is  preferred  to  or  equivalent  to  b, 
and  k *  is  the  largest  range  among  the  K  criterion  vectors. 

There  are  different  types  of  the  ELECTRE  method,  often  referred  to  as  ELEC- 
TRE  I,  ELECTRE  II  and  ELECTRE  III.  Fulop  (2005)  says  that  ELECTRE  I  is  used 
for  partial  ranking  and  to  choose  a  set  of  alternatives  while  ELECTRE  II  is  used  for 
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ranking  the  alternatives.  He  states  an  outranking  degree  is  established  in  ELECTRE 
III  and  this  one  is  more  complicated  than  the  other  ones  because  of  its  structure. 

2.2.5  PROMETHEE  Method.  PROMETHEE  (Preference  Ranking 
Organization  Method  for  Enrichment  Evaluations)  method  was  proposed  by  Brans 
and  Vincke  (1985).  Basically  this  method  has  two  different  types.  PROMETHEE 
I  has  been  designed  for  partial  ranking  and  PROMETHEE  II  for  complete  rank¬ 
ing.  Ananda  and  Herath  (2009)  states  there  are  three  steps  for  the  PROMETHEE 
methods. 

•  Define  a  preference  function  for  each  criterion. 

•  Defining  a  multi  criteria  preference  index. 

•  Complete  or  partial  ranking  of  alternatives. 

Later  on,  Abu-Taleb  and  Mareschal  (1995)  described  the  fundamentals  of  the 
method  as  follows:  First,  a  generalized  criterion  is  developed  to  correspond  to  each  of 
the  k  criteria.  After  that  a  preference  function  Pi(x,  y )  may  be  defined  which  measures 
the  DM’s  preference  intensity  for  alternative  a  over  alternative  b  for  each  criterion  j. 
The  function  Pj(a,  b )  lies  in  the  interval  [0, 1].  This  function  can  be  represented  on  a 
scale  as  below. 

Pj(a,b )  =  0  for  indifference:  /)(«)  =  fi(b ) 

Pj{a,b)  0  for  weak  preference:  ft(a)  >  fi(b ) 

Pj(a,b)  1  for  strong  preference:  fi(a)  fi(b) 
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Pj(a,b)  =  1  for  strict  preference:  fi(a)  fi(b) 


The  difference  in  evaluations  between  alternative  a  and  alternative  b  in  terms  of 
criterion  j  is  defined  as  in  Equation  (2.17)  and  a  preference  function  index  is  defined 
as  in  Equation  (2.18): 

dj  —  fi(a)  —  fi(b)  (2.17) 

k 

7 r(a,  6)  =  WjPj(a,b )  (2.18) 

3= 1 

where  Wj (j  =  1, ...,  k)  are  normed  weights  associated  with  the  criteria,  so  that  7r (a,  b) 
also  varies  from  0  to  1.  The  following  preference  flows  are  then  defined: 

The  leaving  flow  :  <~p+{a)  =  ^  7r(a,  b)  (2.19) 

beA 

The  entering  flow  :  ^  7r(a,  b)  (2.20) 

beA 

The  net  flow  :  (p{a)  =  <^+(a)  —  (p~(a )  (2.21) 

The  larger  <p(a),  the  better  the  alternative  a  is.  Therefore  this  flow  provides  a 
complete  ranking  of  the  alternatives. 

2.2.6  Analytic  Hierarchy  Process.  The  Analytic  Hierarchy  Process, 
introduced  by  Saaty  (1977,  1980),  is  a  widely  used  MCDA  method  and  probably  the 
most  popular  in  many  areas.  The  purpose  of  AHP  is  to  help  DMs  in  organizing 
their  values  and  judgments  to  make  more  effective  decisions  and  transfer  them  into 
quantitative  ratios  (Saaty,  1994).  So,  AHP  combines  both  qualitative  and  quantitative 
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data  together  for  better  decisions.  In  AHP  a  hierarchy  is  created,  which  consists  of 
criteria  and  sub-criteria  and  an  overall  objective  at  the  top. 

The  methodology  of  AHP  is  based  on  pairwise  comparison.  It  tries  to  define 
how  important  is  criterion  a  with  respect  to  criterion  b.  The  DM  makes  pairwise 
comparisons  of  all  criteria  in  the  hierarchy  using  a  1-9  scale.  Fulop  (2005)  explains 
this  scale  as  follows: 

1  =  Equal  importance  or  preference. 

3  =  Moderate  importance  or  preference  of  one  over  another. 

5  =  Strong  or  essential  importance  or  preference. 

7  =  Very  strong  or  demonstrated  importance  or  preference. 

9  =  Extreme  importance  or  preference. 

Generally  the  pairwise  comparison  data  can  be  analyzed  in  two  ways,  regression 
analysis  or  an  eigenvalue  technique.  Saaty’s  original  method  is  based  on  the  eigenvalue 
technique.  Ananda  and  Herath  (2009)  explain  that  the  right  eigenvector  of  the  largest 
eigenvalue  of  matrix  A,  which  is  shown  below,  constitutes  the  estimation  of  relative 
importance  of  attributes.  The  pairwise  comparison  matrices  take  the  following  form: 
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where  atJ  represents  the  pairwise  comparisons  rating  for  criteria  i  to  j.  n(n  —  l)/2 
pairwise  comparisons  are  needed  for  a  nxn  matrix.  Saaty  (1977)  proposed  the  right 
eigenvector  method  that  constructs  the  vector  of  priority  weights  and  facilitates  test¬ 
ing  for  inconsistency.  In  the  case  of  perfect  consistency, 

AW  =  nW  (2.22) 

where  A  is  the  nxn  comparison  matrix  and  W  =  (wi,W2,---,wn)T  is  the  preference 
weightings  of  each  criteria.  Saaty  (1977)  proposed  the  following  definition; 

All  =  A  maxW  (2.23) 

where  Xmax  is  the  maximum  eigenvalue  of  matrix  A.  Saaty  (1977,  1980)  proved  that 
the  largest  eigenvalue  \max  is  always  greater  than  or  equal  to  n.  This  approach 
can  cause  a  problem  when  n  is  large,  because  the  comparisons  can  take  a  lot  of 
time  and  can  be  costly.  The  regression  analysis  approach,  which  allows  for  small 
amounts  of  comparisons  was  generated  for  avoiding  the  difficulties  of  the  eigenvector 
approach  (Kolehmainen,  2010). 

Saaty  (1994)  explains  the  difference  between  AHP  and  utility  theory.  Utility 
theory  must  answer  the  question:  how  many  units  of  one  attribute  can  be  traded  off 
with  how  many  units  of  another?  On  the  other  hand,  in  AHP  the  question  generally 
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is:  which  of  two  attributes  is  more  important,  preferred  or  liked  with  respect  to  a 
higher  level  attribute? 

Despite  its  wide  usage  there  are  some  critics  of  the  AHP  method.  The  number  of 
comparisons,  the  comparison  scale,  and  rank  reversal  are  the  main  criticisms  (Kangas 
and  Kangas,  2005).  Although  it  has  some  problems,  it  is  really  easy  to  use  and 
understand  and  it  allows  for  qualitative  data  to  be  put  into  the  model. 

2.2.1  Value  Focused  Thinking.  Generally  there  are  two  kinds  of  con¬ 
ventional  approaches  for  decision  analysis  problems,  alternative-focused  and  value- 
focused.  The  general  method  for  decision  analysis  is  to  choose  one  of  the  initial  set  of 
alternatives,  and  Keeney  (1992)  refers  to  this  as  Alternative  Focused  Thinking  (AFT). 
The  decision  in  AFT  is  only  good  within  given  set  of  alternatives,  but  the  goodness 
of  decision  for  the  problem  is  not  known  specifically.  Alternatives  are  absent  for  to 
achieve  the  values.  Thus  decision  analysis  process  first  should  focus  on  values  and 
then  alternatives  to  reach  that  values.  This  manner  of  approach  is  called  as  Value 
Focused  Thinking  (VFT)  (Keeney,  1992,  1994,  1996).  The  benefits  of  VFT  are  shown 
in  Figure  2.5. 

Keeney  (1992)  states  that  VFT  provides  a  much  more  robust  methodology  for 
not  only  solving  existing  problem  but  also  for  uncovering  the  possible  future  problems. 
There  are  different  ways  to  implement  VFT  to  the  multi  objective/criteria  decision 
analysis  problems.  Weir  (2010)  defines  the  VFT  process  in  ten  steps,  which  has  flexible 
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Figure  2.5:  Benefits  of  VFT  (Keeney,  1992,  1994) 

•  Problem  identification. 

•  Creating  the  value  hierarchy. 

•  Developing  the  measures. 

•  Define  Single  Dimensional  Value  Functions  (SDVF). 

•  Weighting  the  hierarchy. 

•  Alternative  generation. 

•  Scoring  the  alternatives. 

•  Deterministic  analysis. 

•  Sensitivity  or  post  optimality  analysis. 
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•  Conclusions  and  recommendations. 


As  seen  from  the  steps  VFT  use  both  qualitative  and  quantitative  data  together. 
Providing  mathematical  approach,  structured  decision  support,  being  objective  and 
repeatable,  discussions  at  the  low  level  are  the  pros;  subjectivity,  influence  of  bad 
experiences,  and  easy  to  manipulate  the  numbers  are  the  cons  of  VFT  (Weir,  2010). 
Different  VFT  experiences  show  thinking  about  the  strategic  objectives  and  values 
should  get  easier  and  conclude  in  better  decisions  (Keeney,  1994). 

There  are  also  other  types  of  MCDA  methods  like  aspiration  level  approaches 
which  use  a  variety  of  multi  objective  goal  programming  techniques,  fuzzy  methods 
which  use  imprecise  and  uncertain  information,  descriptive  methods  which  examine 
the  relationships  between  the  attributes  or  variables  in  statistical  terminology,  hybrid 
methods  which  are  combination  of  two  or  more  MCDA  method  (Ananda  and  Herath, 
2009). 

2.3  Research  Contribution 

MCDA  applications  are  in  use  in  many  different  disciplines  such  as  economics, 
psychology,  statistic,  and  forestry.  The  Literature,  however,  seems  to  be  lacking  in  any 
research  about  personnel  course/education  planning  system  optimization  or  decision 
support  models. 

There  is  some  research  about  the  personnel  assignment  problem  but  usually 
they  use  MCDA  very  sparingly.  The  research  of  Korkmaz  et  al.  (2008)  is  closest  to 
this  research  concept.  They  looked  for  an  analytic  hierarchy  process  and  bipartite 
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matching  based  decision  support  system  for  the  military  personnel  assignment  prob¬ 
lem.  They  developed  a  simple  computer  program,  which  is  called  ADES,  for  solving 
this  complex  problem.  Their  basic  steps  are: 

Step-1  Form  a  criteria  hierarchy  for  having  the  right  people  in  the  right  jobs. 

Step-2  Differentiate  the  relative  importance  of  the  criteria  by  making  pairwise 
comparisons  (AHP)  for  each  position. 

Step-3  Define  the  personnel  information  related  to  the  criteria  for  each  person¬ 
nel. 

Step-4  Create  the  position  preferences  by  using  position  information  and  per¬ 
sonnel  information. 

Step-5  Input  the  personnel  preferences. 

Step-6  Make  the  assignment  by  bipartite  matching. 

This  research  differs  from  their  research  in  the  value  hierarchy  and  functions; 
however  because  of  the  similarities  in  the  personnel  data  some  common  criteria  may 
be  used.  Moreover  this  research  is  also  going  to  consider  the  cost  of  the  assignments. 
Personnel  preferences  are  not  going  to  be  used  in  this  research.  Specifically  this 
research  finds  the  maximum  value  of  personnel  -  course/education  matches  for  an 
organization  while  taking  into  consideration  the  cost. 

The  next  chapter  presents  the  methodology  of  this  research  and  model  verifica¬ 
tion. 
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III.  Methodology 


This  chapter  explains  the  methodology  that  is  used  to  solve  the  TURAF  per¬ 
sonnel  course/education  planning  problem.  First,  it  builds  a  criteria  hierarchy  that 
belongs  to  the  problem.  Then  it  determines  the  measures  and  value  functions  used. 
After  that  it  uses  AHP  to  determine  the  weights  of  the  criteria.  Then  it  will  solve 
two  optimization  problems  from  two  sub-problems  of  the  main  problem,  maximum 
number  of  matches  and  maximum  weighted  value  .  Since  the  problem  is  formulated  as 
bipartite  structure,  the  Jonker-Volgenant  Algorithm  for  the  linear  assignment  prob¬ 
lem  is  used  for  optimization.  Finally,  this  chapter  discusses  the  verification  of  the 
model. 

3.1  Background 

Recall  the  motivation  of  this  research  is  to  assign  the  most  appropriate  personnel 
from  the  TURAF  to  a  course.  The  solution  approach  uses  a  multi  criteria  decision 
analysis  method,  VFT,  and  bipartite  matching.  VFT  provides  structured  decision 
support  including  qualitative  and  quantitative  data.  AHP  is  used  in  weighting  the 
value  hierarchy.  Bipartite  matching  is  one  of  the  assignment  matching  algorithms, 
which  is  also  known  as  two  sided  matching.  This  problem  has  m  personnel  in  one 
side,  and  n  courses  on  the  other  side.  The  objective  of  the  TURAF  is  to  maximize 
the  value  of  the  overall  matching  of  personnel  and  courses.  The  cost  is  also  going 
to  be  considered  while  finding  the  value.  In  the  TURAF,  the  courses  are  grouped  as 
abroad  and  in  country,  but  both  of  them  have  the  same  structure. 
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3. 2  Model  Formulation 


3.2.1  Criteria  Hierarchy.  This  research  structures  the  criteria  hierar¬ 
chy  according  to  the  TURAF  instructions  and  opinions  of  SMEs.  There  is  an  overall 
objective  at  the  top  of  the  hierarchy  and  there  are  some  main  criteria  and  sub-criteria 
under  this  objective.  While  most  of  the  criteria  are  the  same,  for  the  in  country 
courses  the  language  score  and  day  point  score  are  not  used. 


Figure  3.1:  Criteria  Hierarchy 


This  hierarchy  has  five  main  criteria  and  13  sub-criteria.  The  five  main  criteria 
are  a  grouping  of  the  sub-criteria,  thus  explanation  of  sub-criteria  will  help  in  the 
understanding  of  the  general  structure  of  the  hierarchy. 
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Branch:  There  are  more  than  20  branches  in  the  TURAF  such  as  pilot,  main¬ 
tenance,  intelligence,  communication,  personnel,  acquisition,... etc.  This  research  only 
considers  eight  branches  and  represents  them  as  Branch-1,  Branch-2,..., Branch-8  in¬ 
stead  of  their  real  names. 

Rank:  This  research  is  interested  in  officer’s  course/education  planning,  so  six 
ranks  are  used.  Again  Rank-1,  Rank-2,...,  Rank-6  codes  are  used  in  the  name  of  the 
actual  ranks. 

Language  Score:  There  is  an  official  test  for  all  government  workers  for  foreign 
languages  in  Turkey.  This  test  is  used  for  selection  criteria  in  most  of  the  application 
procedures.  Applicants  have  to  be  above  60  to  be  eligible  for  the  selection  process, 
and  the  maximum  score  is  100. 

Evaluation  Score:  Every  person  in  the  TURAF  is  evaluated  yearly  and  these 
scores  are  saved  in  the  personnel  records.  Applicants  must  be  above  90  for  to  be  eli¬ 
gible  for  the  course/education  assignment  process  according  to  TURAF  instructions. 
The  maximum  evaluation  score  is  100. 

Awards  Score:  Every  person  will  get  a  written  appreciation  or  pin  for  their 
service  sometime  in  their  active  duty  life.  There  is  a  general  chart  for  calculation  of 
their  awards  score  in  the  TURAF. 

Punishment  Score:  It  is  similar  to  awards  points.  If  a  person  receives  pun¬ 
ishment,  then  his/her  evaluation  points  are  effected  according  to  a  general  chart  for 
calculation  of  a  punishment  score.  The  punishment  score  has  a  negative  effect. 
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Day  Point:  This  is  from  the  TURAF  instruction  about  courses.  If  an  applicant 
has  been  abroad  before  then  this  will  affect  his/her  overall  score  negatively.  There 
are  three  categories  of  countries  which  have  coefficients  of  1,  0.9  and  0.7.  Day  point 
is  calculated  by  (Number  of  days  abroad  x  0.05  x  country  coefficient). 

Graduation:  It  is  the  highest  education  level  a  person  has  achieved.  The  possi¬ 
bilities  are  University,  Master  Degree  and  PhD. 

Courses:  It  is  the  number  of  courses  that  were  taken  after  joining  the  military 
for  a  given  person.  The  applicant  who  has  not  been  assigned  or  has  been  assigned 
to  fewer  courses  than  the  other  applicants  has  a  priority  according  to  the  TURAF 
instruction. 

Positions  Worked:  There  are  many  different  positions  in  the  TURAF.  This 
research  classifies  these  positions  as  technical  level,  tactical  level,  and  strategic  level. 
Position-1  represents  technical  level,  Position-2  represents  tactical  level,  and  Position- 
3  represents  strategic  level. 

Course  Success  Status:  This  is  the  average  of  a  person’s  previous  course  grades. 
An  applicant  must  have  an  average  above  60  to  being  eligible  for  the  selection  process 
according  to  the  TURAF  instruction. 

Months  of  Service:  Total  number  of  months  of  military  service. 

Degree  of  Compatibility:  It  is  the  compatibility  between  the  alternative  and  the 
applicant’s  career  plan. 
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3.2.2  Value  Functions.  After  building  the  hierarchy  the  next  step  is 
to  create  the  value  functions.  This  research  was  implemented  by  using  the  Hierarchy 
Builder  (Weir,  2008)  software.  Value  functions  were  determined  by  the  inputs  of 
SMEs  and  the  TURAF  instructions.  This  research  uses  seven  categorical  and  six 
continuous  value  functions  for  the  model.  Next,  one  example  of  each  type  of  function 
is  explained.  All  the  other  functions  are  shown  in  Appendix-A. 


Figure  3.2:  Value  Function  of  Branch 


Figure  3.3:  Value  Function  of  Language  Score 
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Figure  3.2  is  an  example  of  a  categorical  value  function  and  Figure  3.3  is  an  ex¬ 
ample  of  continuous  value  function.  In  categorical  value  functions  the  most  preferred 
category  has  value  of  1  and  the  least  preferred  category  has  value  of  0.  Therefore 
course’s  most  preferred  branch  or  branches  will  be  in  Category-1  and  the  rest  of  the 
branches  will  be  in  Category-2  in  Figure  3.2.  The  continuous  value  functions  are  clas¬ 
sified  as  increasing  and  decreasing  functions.  In  increasing  functions,  the  minimum 
score  has  value  of  0  and  maximum  score  has  value  of  1.  However,  in  the  decreasing 
functions  the  lowest  score  has  value  of  1  and  the  highest  score  has  value  of  0.  Lan¬ 
guage  score  lies  between  60  and  100  in  Figure  3.3.  The  break  points  and  shapes  of 
the  functions  are  determined  by  the  inputs  of  SMEs. 

3.2.3  Weighting  the  Hierarchy.  The  AHP  method  was  used  for 
weighting  the  hierarchy.  The  pairwise  comparisons  were  done  by  SMEs  in  the  TU- 
RAF  Headquarters.  The  abroad  and  in  country  hierarchies  have  different  weights  as 
they  were  weighted  separately.  The  weights  are  shown  in  Table  3.1. 

Saaty  (1980)  indicates  that  a  consistency  ratio  less  than  0.1  does  not  affect  the 
ratings  too  much.  This  consistency  ratio  is  calculated  automatically  by  the  Hierarchy 
Builder  (Weir,  2008)  software.  All  weights  for  this  research  we  are  consistent. 

3.2.4  Overall  Score  and  Benefit/Cost  Ratio.  Once  all  of  the  data 
is  input,  an  additive  value  function  is  used  to  calculate  the  overall  value  of  a  specific 
assignment.  Next  the  benefit/cost  ratio  is  calculated. 
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Table  3.1:  Weights  of  Criteria 


Criteria 

Abroad 

In  Country 

Branch 

0.094 

0.064 

Rank 

0.047 

0.064 

Language  Score 

0.096 

- 

Evaluation  Score 

0.122 

0.343 

Awards  Score 

0.041 

0.088 

Punishment  Score 

0.031 

0.038 

Day  Point 

0.238 

- 

Graduation 

0.014 

0.023 

Courses 

0.029 

0.046 

Positions  Worked 

0.010 

0.051 

Course  Success  Status 

0.039 

0.032 

Months  of  Service 

0.039 

0.020 

Degree  of  Compatibility 

0.200 

0.229 

As  in  all  militaries,  the  TURAF  has  funds  for  expenses.  The  fund  for  courses  and 
education  is  used  for  not  only  that  but  also  for  other  demands.  Therefore  analysis 
of  this  resource  allocation  is  important.  The  Benefit/Cost  Ratio  is  a  widely  used 
method  because  it  shows  the  cost  per  unit  value.  For  this  research  it  can  be  calculated 
by  simply  dividing  the  benefit  (overall  value  from  the  model)  of  an  applicant  for  a 
given  course  to  the  cost  of  that  course.  Next,  the  benefit/cost  ratio  is  normalized  to 
overcome  the  small  ratios  that  are  generated. 

3.2.5  Assignment  Matrix.  This  research  uses  two  types  of  assignment 
matrices.  The  first  is  formed  by  just  0’s  and  l’s  which  shows  the  feasible  matches.  If 
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personnel  i  can  be  assigned  to  course  j,  this  element  of  the  matrix  will  have  value  of 
1  otherwise  a  value  of  0.  The  second  matrix  for  the  optimization  algorithm  is  formed 
by  the  normalized  benefit/cost  ratios  of  each  personnel-assignment  match.  In  both 
matrices  rows  represent  the  personnel  and  columns  represent  courses. 


3. 3  Optimization  Phase 

3.3.1  General.  The  values  in  an  assignment  matrix  are  the  costs  or 
weights  of  assigning  personnel  i  to  course  j.  Because  of  the  unimodular  property  of 
the  constraints  and  linearity  in  the  objective  function,  a  Linear  Programming  (LP) 
problem  will  solve  the  problem  and  result  in  an  all  integral  solution. 


3.3.2  Sets,  Parameters,  and  Decision  Variables.  Before  the  math¬ 
ematical  formulation,  sets,  parameters,  and  decision  variables  need  to  be  defined. 
Table  3.2:  Parameters,  Sets,  and  Decision  Variables  of  Model 


m 

Total  number  of  personnel  in  a  given  selection  process 

n 

Total  number  of  courses  in  a  given  selection  process 

i  =  1,  2, ...,  m 

The  set  of  personnel  in  a  given  selection  process 

j  =  1, 2, ...,  n 

The  set  of  courses  in  a  given  selection  process 

Sij 

Score  of  assigning  personnel  i  to  a  course  j 

Cj 

Cost  of  course  j 

Vij 

Normalized  value  of  assigning  personnel  *  to  a  course  j 

Decision  variable.  1  if  personnel  i  can  be  assigned  to  course  j,  0  otherwise 

Z 

Maximum  number  of  assignments  for  all  personnel  in  i  to  the  courses  in  j 

w 

Maximum  weighted  assignments  for  all  personnel  in  i  to  the  courses  in  j 

Rij 

The  matrix  which  is  set  up  by  ratio  s,j  to  Cj  ( Sij/cj ) 

j,* 

The  maximum  element  of  matrix  R,j 

3.3.3  Problem  Formulation.  This  research  divides  the  problem  into 
two  sub-problems.  The  first  one  finds  the  maximum  matching  and  the  second  one 
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finds  the  maximum  weighted  value.  Two  problems  are  used  to  see  if  the  maximum 
weighted  matching  is  also  a  maximum  matching.  After  solving  this  problem  the  DM 
has  to  decide  which  way  s/he  wants  to  choose,  maximum  matches  but  less  value  or  the 
maximum  value  but  less  matches.  In  this  research,  all  maximum  weighted  matches 
were  also  maximum  matching,  but  this  cannot  be  guaranteed  in  general. 

In  Sub-problem(l)  the  objective  is  to  find  the  maximum  matches  between  per¬ 
sonnel  and  courses.  The  value  of  these  matches  is  found  by  adding  the  weights  of 
matched  pairs. 

m  n 

Max  Z  =  EE  Xij  (3.1) 

i=  1  j= 1 

subject  to 


m 


^  <  1  J  =  1,2,  ,n 

i= 1 

(3.2) 

n 

<1  i  —  1,  2, ,  m 

(3.3) 

3= 1 

e  {0,1}  Wi,j 

Model  4:  Sub-problem(l)  Formulation 


In  Sub-problem(2)  to  the  objective  is  to  find  the  maximum  weighted  value  of 
the  matches. 
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Max  W  =  E5>«x«  <3-4> 


i=l 

3= 1 

subject  to 

m 

y!  x%]  <  1 

i= 1 

j  =  1,2,,  n 

(3.5) 

Ev<i 

3= 1 

i  =  1,  2, ,  n 

(3.6) 

Xij  G  {0, 1} 

Vi,  .7 

Model  5:  Sub-problem(2)  Formulation 


3.3.4  Jonker-Volgenant  Algorithm  for  Linear  Assignment  Prob¬ 
lem.  Instead  of  solving  this  LP  problem,  this  research  uses  the  Jonker-Volgenant 
Algorithm  to  solve  the  weighted  bipartite  matching  problem.  The  Jonker-Volgenant 
Algorithm  for  the  linear  assignment  problem,  which  is  based  on  shortest  augmenting 
path,  was  developed  by  Jonker  and  Volgenant  (1987).  Generally,  the  Jonker-Volgenant 
Algorithm  solves  minimization  problems,  but  can  be  converted  to  solve  maximization 
problems  by  multiplying  the  assignment  matrix  by  —1  or  by  subtracting  each  element 
of  assignment  matrix  from  the  maximum  value  of  the  matrix.  This  algorithm  can  be 
used  for  both  square  and  rectangular  matrices.  It  is  faster  than  the  most  of  the  other 
linear  assignment  algorithms  (Jonker  and  Volgenant,  1987). 

In  this  research,  both  sub-problems  are  maximization  problems  and  are  not 
square  matrices  since  the  number  of  courses  always  will  be  less  than  the  number  of 
personnel.  The  algorithm  was  implemented  in  MATLAB  (Mathworks,  R2010a)  and 
the  codes  for  solving  Sub-problem(l)  and  Sub-problem (2)  using  the  Jonker-Volgenant 
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Algorithm  are  in  the  Appendix-B.  This  MATLAB  code  was  written  by  Cao  (2011) 
and  was  changed  only  to  work  with  the  sub-problem  structures. 

3. 3. 5  Post  Analysis.  After  finding  the  optimal  solutions,  a  new  question 
can  be  considered.  How  good  is  the  solution?  This  research  considers  two  kinds  of 
goodness,  goodness  of  the  personnel  pool  and  goodness  of  algorithm’s  solution.  There 
are  two  different  values  for  comparison.  First,  what  is  the  maximum  value  that  can 
be  achieved  by  these  costs  if  every  personnel  had  an  overall  score  of  1,  and  second  find 
the  maximum  value  that  can  be  achieved  by  assigning  the  highest  valued  personnel  in 
relation  to  a  course  to  the  course.  The  formulations  for  these  calculations  are  shown 
in  Equation  3.7  and  3.8  respectively. 


The  ratio  of  Equation  3.8  to  Equation  3.7  shows  the  goodness  of  whole  personnel 
pool.  The  ratio  of  value  which  is  found  by  optimization  algorithm  to  value  found  by 
Equation  3.8  shows  the  goodness  of  model. 

3. 4  Verification 

To  verify  the  matching  algorithm  produced  the  correct  results  when  MATLAB 
solved  each  problem,  previously  solved  small  problems  were  used  to  compare  the  algo- 
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rithm  output  against  known  solutions.  The  problem  was  solved  by  MATLAB  (Math- 
works,  R2010a)  for  all  instance  matrices.  If  both  results  were  equal  in  terms  of 
assignments  and  values  then  the  algorithm  was  considered  successful.  This  procedure 
was  repeated  for  10  times  and  in  every  case,  previous  solutions  and  Jonker-Volgenant 
matching  algorithm  were  equal  to  one  another. 

In  the  next  chapter,  this  methodology  is  applied  to  the  TURAF’s  problem. 
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IV.  Application,  Results,  and  Analysis 


In  this  chapter,  the  results  of  using  the  methodology  from  Chapter  3  on  the 
TURAF’s  problem  are  presented.  Because  of  the  privacy  of  actual  personnel  data  and 
not  being  able  to  gather  some  of  the  data  from  current  TURAF  databases,  randomly 
generated  data  is  used  and  analyzed  according  to  the  model  in  Chapter  3.  Detailed 
analysis  of  a  problem  containing  20  courses  and  50  personnel  is  explained  in  the  next 
sections. 

All  of  the  analysis  in  this  research  was  performed  on  a  computer  with  an  In- 
tel(R)  Core(TM)  i7  CPU  Q740  @1.73GHz  Processor,  8  GB  RAM,  Windows  7  Home 
Premium  64-bit  operating  system.  The  optimal  solutions  were  found  using  MAT- 
LAB  (Mathworks,  R2010a). 

4-1  Courses’  Requirements 

The  model  developed  in  this  research  has  13  criteria.  Nine  of  the  criteria;  lan¬ 
guage  score,  evaluation  score,  awards  score,  punishment  score,  day  point,  courses, 
course  success  status,  months  of  service,  and  degree  of  compatibility;  have  the  same 
SDVF  regardless  of  the  personnel-course  matching.  Four  of  the  criteria  branch,  rank, 
graduation,  and  positions  worked,  have  different  SDVFs  depending  on  the  course/e¬ 
ducation  requirements  found  in  TURAF  instructions.  Abroad  and  in  country  SDVFs 
requirements  are  shown  in  different  tables. 
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Table  4.1:  Abroad  Courses’  Requirements 


Branch 

Rank 

Graduation 

Positions  Worked 

Course 

Category- 1 

Category-2 

Category- 1 

Category-2 

Category-3 

Category- 1 

Category-2 

Category-3 

Category- 1 

Category-2 

Course- 1 

B-l 

others 

R-2,R-3 

R-4 

others 

Master 

PhD 

University 

P-1 

others 

Course-2 

B-l 

others 

R-2,R-3 

R-4 

others 

Master 

PhD 

University 

P-1 

others 

Course-4 

B-l,B-2,B-4 

others 

R-3 

R-4 

others 

Master 

PhD 

University 

P-2 

others 

Course-7 

B-2 

others 

R-3,R-4 

R-5 

others 

Master 

PhD 

University 

P-2 

others 

Course-9 

B-5,B-7 

others 

R-5 

R-6 

others 

PhD 

Master 

University 

P-3 

others 

Course-10 

B-l, B-2 

others 

R-2,R-3 

R-4 

others 

Master 

PhD 

University 

P-2 

others 

Course-11 

B-l, B-2 

others 

R-2,R-3 

R-4 

others 

Master 

PhD 

University 

P-2 

others 

Course-15 

B-3 

others 

R-3 

R-4 

others 

Master 

PhD 

University 

P-2 

others 

Course-16 

B-6 

others 

R-2,R-3 

R-4 

others 

Master 

PhD 

University 

P-1 

others 

Course-19 

B-l, B-3 

others 

R-3,R-4 

R-2 

others 

Master 

PhD 

University 

P-2 

others 

Course-20 

B-4 

others 

R-4 

R-5 

others 

PhD 

Master 

University 

P-3 

others 

Table  4.2:  In  Country  Courses’  Requirements 


Branch 

Rank 

Graduation 

Positions  Worked 

Course 

Category- 1 

Category-2 

Category- 1 

Category-2 

Category-3 

Category- 1 

Category-2 

Category- 3 

Category- 1 

Category-2 

Course-3 

B-4,B-5,B-8 

others 

R-3,  R-4 

R-2 

others 

PhD 

Master 

University 

P-2 

others 

Course-5 

B-l 

others 

R-4, R-5 

R-6 

others 

PhD 

Master 

University 

P-3 

others 

Course-6 

B-l 

others 

R-4, R-5 

R-6 

others 

PhD 

Master 

University 

P-3 

others 

Course-8 

B-6 

others 

R-3, R-4 

R-5 

others 

Master 

PhD 

University 

P-2 

others 

Course-12 

B-l, B-2, B-3 

others 

R-2, R-3 

R-4 

others 

Master 

PhD 

University 

P-1 

others 

Course-13 

B-l, B-2, B-3 

others 

R-2, R-3 

R-4 

others 

Master 

PhD 

University 

P-1 

others 

Course-14 

B-l, B-2, B-3 

others 

R-2, R-3 

R-4 

others 

Master 

PhD 

University 

P-1 

others 

Course-17 

B-5,B-7,B-8 

others 

R-2 

R-l 

others 

Master 

PhD 

University 

P-1 

others 

Course-18 

B-5,B-7,B-8 

others 

R-2 

R-l 

others 

Master 

PhD 

University 

P-1 

others 

In  these  tables,  ”B”  represents  branch,  ”R”  represents  rank,  and  ”P”  represents 
position.  The  courses  in  bold  are  those  in  which  nobody  can  be  assigned  to  that 
course  other  than  those  personnel  in  Category-1  in  the  branch  criteria.  As  seen,  some 
courses  have  the  same  requirements,  which  means  they  belong  to  the  same  course 
there  are  as  many  of  them  as  there  are  quotas  for  that  course. 
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4-2  Personnel  Data 


50  sets  of  personnel  data  was  randomly  generated  using  Microsoft  Excel  (Office 
Home  and  Student,  2007).  After  the  random  generation,  some  values  were  manip¬ 
ulated  to  make  the  data  more  representative  of  the  real  world  data.  The  general 
personnel  data  is  shown  in  Table  4.3.  There  are  12  criteria  values  for  personnel  data. 
The  degree  of  compatibility  criteria  is  not  included  in  the  general  personnel  data. 
Because  12  criteria  values  are  the  same  for  every  courses,  but  personnel  degree  of 
compatibility  data  is  changed  according  to  the  course.  Therefore  that  criteria  was 
generated  for  every  course  separately. 

4-3  Personnel  Scores 

When  the  personnel  data  is  input  in  the  model,  Hierarchy  Builder  (Weir,  2008) 
gives  an  overall  value  for  each  personnel  for  a  particular  course  and  ranks  them  all. 
The  ranking  can  be  displayed  both  graphically  and  numerically.  Course  1,  2,  and  3 
personnel  score  rankings’  graphical  representations  are  shown  in  Figure  4.1  and  4.2 
as  an  example.  Course  1  and  2  are  the  same  course,  so  they  have  the  same  rankings. 
In  the  Figure  4.1  and  4.2  ”P”  represents  Personnel. 
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Table  4.3:  Personnel  Data 
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Figure  4.1:  Course  1-2  Ranking 
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Figure  4.2:  Course  3  Ranking 


49 


4-4  Benefit/Cost  Ratio 


In  order  to  find  benefit/cost  ratios,  cost  data  was  generated  for  each  course. 
The  cost  table  for  courses  is  shown  below.  These  are  the  cost  of  a  course  for  a  given 
personnel  who  was  assigned  that  course.  As  was  mentioned  before  it  is  assumed  that 
these  costs  are  the  same  for  all  personnel  within  the  same  course. 


Table  4.4:  Cost  of  Courses 


Costs  of  Courses  (in  dollars) 

Course- 1 

500 

Course- 11 

400 

Course-2 

500 

Course- 12 

340 

Course-3 

240 

Course- 13 

340 

Course-4 

400 

Course-14 

340 

Course-5 

320 

Course- 15 

380 

Course-6 

320 

Course- 16 

460 

Course-7 

430 

Course- 17 

300 

Course-8 

240 

Course- 18 

300 

Course-9 

420 

Course- 19 

410 

Course- 10 

400 

Course-20 

390 

The  personnel  scores  for  each  course  show  us  the  benefits  of  assignments  for  the 
TURAF.  Hence  the  benefit/cost  ratios  are  found  by  dividing  the  personnel  scores  by 
the  related  cost.  Those  benefit/cost  ratios  are  going  to  determine  the  overall  value  of 
Sub-problems.  Instead  of  the  values,  goodness  of  the  personnel  pool  and  goodness  of 
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the  model  can  provide  more  insights  to  the  DM.  Although  the  values  are  not  worth 
enough  to  think  as  goodness,  the  remarkable  numbers  are  better  to  show  to  the  DM. 
Therefore  benefit/cost  ratios  are  normalized  by  dividing  the  maximum  benefit/cost 
ratio  of  the  matrix.  The  normalized  benefit/cost  ratios  are  shown  in  Table  4.5. 

4-5  Optimization  and  Results 

The  MATLAB  code  described  in  Chapter  3,  which  is  based  on  the  Jonker- 
Volgenant  Algorithm,  is  used  for  the  optimization  phase.  The  assignment  matrix, 
and  normalized  benefit/cost  ratio  matrix,  are  the  inputs  for  the  MATLAB  calculation. 
The  results  of  the  optimization  matchings  are  shown  in  Table  4.6. 

The  maximum  value  that  can  be  reached  by  these  costs  was  found  by  Equa¬ 
tion  3.7,  and  the  maximum  value  that  we  can  reach  by  these  costs  and  personnel  was 
found  by  Equation  3.8. 


Maximum  Value  by  Cost  =  13.862 
Maximum  Value  by  Cost  and  Personnel  =  12.280 

These  results  show  that  the  goodness  of  personnel  pool  has  88.59%  of  maximum 
value,  which  means  a  good  set  of  personnel  is  available.  Looking  at  the  results  of  Sub- 
problem^),  since  we  have  a  high  percentage  of  achievable  value,  it  appears  that  the 
algorithm  also  works  well.  When  a  good  set  of  personnel  are  not  available,  i.e  there 
is  low  overall  value,  some  other  course  of  actions  may  need  to  be  implemented  to  get 
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Table  4.6:  Results 


Total  Number 

of  Matches 

Overall 

Value 

Max.  Value 
by  Cost 

Max.  Value 
by  Cost  and 
Personnel 

Sub-problem  1 

20 

8.986 

66.76% 

73.18% 

Sub-problem  2 

20 

11.933 

88.65% 

97.17% 

better  results  for  the  TURAF.  The  break  point  for  making  the  decision  about  whether 
a  set  of  personnel  is  good  or  bad  must  be  determined  by  the  DM. 


4-6  Post  Optimality  Analysis 

To  show  the  goodness  of  this  model  and  algorithm,  post  optimality  analysis 
is  done  with  different  sizes  of  problems.  The  model’s  speed  is  incomparable  versus 
hand  solving,  seconds  versus  hundreds  of  hours.  The  speed  of  this  methodology  will 
allow  the  officials  to  run  many  ”what-if”  scenarios  and  arrive  at  better  decisions  and 
propose  different  courses  to  the  DM. 


Table  4.7:  Results  of  20  Courses  in  Different  Personnel  Sizes 


Personnel  Size 

1000 

2000 

3000 

Average  Solution  Time  (CPU  time  in  secs) 

3.181 

12.057 

27.083 

Theoretic  Maximum  Value 

13.862 

13.862 

13.862 

Maximum  Value  of  Problem 

12.365 

12.412 

12.412 

Maximum  Value  of  Model 

12.134 

12.302 

12.322 

Goodness  of  Personnel  Pool 

89.20% 

89.54% 

89.54% 

Goodness  of  Model 

98.13% 

99.11% 

99.27% 
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Table  4.8:  Results  of  30  Courses  in  Different  Personnel  Sizes 


Personnel  Size 

1000 

2000 

3000 

Average  Solution  Time  (CPU  time  in  secs) 

3.176 

12.011 

27.049 

Theoretic  Maximum  Value 

22.073 

21.811 

21.811 

Maximum  Value  of  Problem 

19.430 

19.461 

19.480 

Maximum  Value  of  Model 

18.957 

19.161 

19.227 

Goodness  of  Personnel  Pool 

88.03% 

89.23% 

89.31% 

Goodness  of  Model 

97.57% 

98.46% 

98.70% 

Table  4.9:  Results  of  40  Courses  in  Different  Personnel  Sizes 


Personnel  Size 

1000 

2000 

3000 

Average  Solution  Time  (CPU  time  in  secs) 

3.161 

12.015 

27.053 

Theoretic  Maximum  Value 

28.764 

28.764 

28.764 

Maximum  Value  of  Problem 

25.322 

25.518 

25.537 

Maximum  Value  of  Model 

24.621 

25.043 

25.145 

Goodness  of  Personnel  Pool 

88.03% 

88.72% 

88.78% 

Goodness  of  Model 

97.23% 

98.14% 

98.46% 

The  tables  show  that,  personnel  size  has  an  effect  on  solution  times.  However, 
the  solution  time  is  still  very  small  even  for  large  sizes  of  personnel.  Consistent 
prediction  of  run  times  is  not  possible  as  it  is  very  dependent  on  the  new  set  of 
personnel  and  courses. 
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Due  to  the  large  number  of  candidates  for  each  course  the  algorithm  is  able  to 
achieve  a  high  percentage  for  goodness  of  the  personnel  pool.  Nevertheless  the  DM 
may  determine  a  specific  cutdown  point  for  goodness  of  the  personnel  pool  and  results 
may  need  to  be  reevaluates  as  necessary.  When  the  problem  is  reevaluated  the  courses 
which  have  lowest  benefit/cost  ratio  can  be  canceled  course  allowing  assignment  of 
more  personnel  to  the  ones  which  have  highest  benefit/cost  ratios  or  a  course  can  be 
totally  canceled. 

Because  of  the  small  solution  times,  officials  can  run  many  such  scenarios.  Thus 
they  can  build  a  best  personnel  pool  for  their  courses  by  excluding  the  matches  in 
an  optimal  solution  one  by  one  or  all  the  matches  in  a  previous  run.  After  that,  a 
Graphical  User  Interface  (GUI)  can  be  created  for  the  DM.  The  DM  may  select  the 
personnel  whom  s/he  does  not  want  to  assign  to  any  course  or  s/he  can  make  specific 
assignments.  Then  officials  can  make  the  assignments  which  have  better  value  for  the 
Air  Force. 
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V.  Conclusions  and  Future  Work 


This  chapter  summarizes  the  research,  and  discuss  the  conclusions  and  possible 
future  work  from  this  research. 

5.1  Summary  of  the  Research 

In  the  first  chapter  of  this  research,  the  problem  is  defined  and  objectives  of  the 
research  are  stated.  The  necessary  assumptions  are  also  stated. 

The  general  structure  of  an  assignment  problem,  multi  criteria  decision  analysis, 
and  decision  support  systems  are  introduced  in  Chapter  2.  The  multi  criteria  decision 
analysis  methods  are  studied  and  a  research  contribution  is  shown. 

The  methodology  and  its  implementation  are  introduced  in  Chapter  3.  The 
value  model  is  structured,  value  functions  are  created  and  weights  are  determined. 
Then  the  way  of  building  an  assignment  matrix  is  shown  and  sets,  parameters,  and 
decision  variables  are  defined.  Finally  the  problem  is  formulated  and  a  solution  algo¬ 
rithm  stated. 

Chapter  4  presents  the  analysis  phase  of  the  research.  The  methodology  is  tested 
by  an  example.  Post  optimality  analysis  is  done  to  show  robustness  of  the  results. 

In  this  chapter,  conclusions  from  the  results  are  explained  and  some  other 
courses  of  action  are  recommended  for  future  research  on  the  same  or  similar  problems. 
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5.2  Conclusions 


This  research  deals  with  building  a  multi  criteria  decision  support  model  for  the 
TURAF  course/education  planning  system.  It  creates  a  value  model  which  considers 
more  criteria  than  the  current  system  and  use  a  computer-based  algorithm  to  solve 
this  problem. 

The  value  model  in  this  research  reflects  the  main  concerns  of  both  TURAF  in¬ 
structions  and  SMEs.  The  proposed  solution  methodology  finds  the  maximum  number 
of  matches  in  Sub-Problem(l)  and  maximum  weighted  value  in  Sub-Problem(2).  Post 
optimality  analysis  shows  the  optimal  solution  is  achieved  in  a  reasonably  short  time 
while  the  current  system  takes  weeks  for  assignments  and  it  also  does  not  look  for 
optimality. 

Most  of  the  subsystems  in  human  resource  management,  one  of  which  them 
the  assignment  subsystem,  not  only  need  quantitative  data  but  also  qualitative  data 
evaluation  due  to  its  unique  structure.  Because  of  the  complexity  of  human  resource 
management,  sometimes  optimization-based  models  may  not  have  the  operational 
feasibility.  The  military  environment  makes  this  problem  more  complicated  due  to 
its  own  rules.  Therefore,  flexibility  in  the  solution  and  model  are  needed.  GUIs  can 
be  created  to  enhance  the  flexibility  of  solutions  and  new  software  can  be  developed 
for  managing  all  of  these  tools. 

The  TURAF  has  written  course  requirements,  yet  she  has  not  put  them  in 
computer  database.  Thus,  a  course  database  has  to  be  created  to  use  this  model 
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effectively.  Moreover,  the  Career  Planning  Branch  has  to  generate  compatibility  dia¬ 
grams  between  personnel  and  courses.  This  model  and  solution  methodology  also  take 
into  account  the  cost  which  is  not  the  same  in  the  current  process.  To  improve  the 
effectiveness  of  both  manpower  and  budget  utilizations  within  the  whole  organization 
needs  to  be  considered.  To  aid  in  seeing  the  big  picture  and  provide  better  utilization 
for  the  Air  Force,  all  the  assignments  must  be  done  at  the  same  time  instead  of  course 
by  course  matching. 

Although  this  methodology  finds  an  optimal  solution,  it  is  still  going  to  be  an 
initial  solution  and  decision  support  for  the  officials  unless  the  whole  model  and  solu¬ 
tion  methodology  are  imported  to  the  related  TURAF  instructions.  However,  using 
this  model  and  solution  methodology  is  going  to  remarkably  decrease  the  workload 
of  officials.  Also,  this  kind  of  detailed  model  can  make  the  selection  process  more 
objective  and  reliable  which  may  result  in  better  personnel  morale  and  motivation. 

5.3  Future  Work 

For  future  work  on  the  same  problem  or  a  similar  problems  following  research 
can  be  done; 

•  Personnel  preferences  can  be  added  to  the  model. 

•  Different  multi  criteria  decision  analysis  methods  can  be  used  for  the  model. 

•  The  affects  of  weights  can  be  examined.  Thus  the  importance  of  the  criteria 
can  be  known  better. 
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•  Different  sensitivity  or  post  optimality  analysis  methods  such  as  Dantzig  Cut 
can  be  implemented  to  the  problem. 

•  A  faster  solution  algorithm,  computer  program  or  computer  language  can  be 
researched. 

•  General  course  and  education  plans  can  be  structured  according  to  personnel 
data,  which  can  be  predicted  by  some  probabilistic  methods,  and  value  model. 
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Appendix  A.  Value  Functions 
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Figure  A.l:  Value  Function  of  Branch 


The  most  preferred  branch  or  branches  will  be  in  Category-1,  and  the  rest  will 
be  in  Category-2. 


Figure  A. 2:  Value  Function  of  Rank 


The  most  preferred  rank/s  will  be  in  Category-1,  the  second  preferred  rank/s 
will  be  in  Category-2,  and  the  rest  will  be  in  Category-3. 
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Figure  A. 3:  Value  Function  of  Language  Score 


The  minimum  score  (60)  has  value  of  0,  the  score  of  70  has  value  of  0.75,  and 
the  score  of  100  has  value  of  1. 


Evaluation  Score 


Figure  A. 4:  Value  Function  of  Evaluation  Score 


The  minimum  score  (90)  has  value  of  0,  the  score  of  95  has  value  of  0.2,  and  the 
score  of  100  has  value  of  1. 
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Figure  A. 5:  Value  Function  of  Awards  Score 


The  minimum  score  (0)  has  value  of  0,  the  score  of  2  has  value  of  0.85,  and  the 
score  of  4  has  value  of  1. 


Figure  A. 6:  Value  Function  of  Punishment  Score 


The  punishment  score  has  a  decreasing  function.  The  minimum  score  (0)  has 
value  of  1,  the  score  of  0.2  has  value  of  0.5,  and  the  score  of  1  has  value  of  0. 
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Figure  A.  7:  Value  Function  of  Day  Point 

The  day  point  also  has  a  decreasing  function.  The  minimum  score  (0)  has  value 
of  1,  the  score  of  10  has  value  of  0.4,  and  the  score  of  60  has  value  of  0. 


Figure  A. 8:  Value  Function  of  Graduation 

All  the  Turkish  officers  are  graduated  at  least  from  the  university.  Thus  the 
candidate  whose  highest  degree  is  university  will  be  in  Category-3  and  has  value 
of  0.  Category-1  is  the  course’s  most  preferred  one,  and  Category-2  is  the  second 
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preferred  one.  That  means  Master  Degree  and  PhD  will  be  in  Category-1  or  Category- 


2  according  to  course’s  qualification. 


Figure  A. 9:  Value  Function  of  Positions  Worked 

We  classified  the  positions  as  technical,  tactical,  and  strategic  level.  The  pre¬ 
ferred  position  will  be  in  Category-1  and  the  others  will  be  in  Category-2. 


Figure  A.  10:  Value  Function  of  Course  Success  Status 

Candidate  has  to  have  score  over  60  for  becoming  eligible  for  the  selection  pro¬ 
cess.  This  score  lays  between  60  and  100.  The  minimum  score  (60)  has  value  of  0, 
score  of  80  has  value  of  0.75,  and  score  of  100  has  value  of  1. 
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Months  of  Service 


Figure  A. 11:  Value  Function  of  Months  of  Service 


According  to  the  TURAF  instruction  junior  personnel  has  priority  for  planning 
for  a  course.  The  ranks  of  First  Lieutenant  and  Captain  are  being  considered  as  most 
productive  times  of  personnel.  After  talking  with  SMEs  value  of  0.3  for  the  service 
between  0  and  72  months,  value  of  1  for  the  service  between  73  and  180  months, 
value  of  0.65  for  the  service  between  181  and  300  months,  and  finally  value  of  0  for 
the  service  between  301  and  336  months  are  determined. 


Figure  A.  12:  Value  Function  of  Degree  of  Compatibility 
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This  value  function  is  for  degree  of  compatibility  between  a  course  and  candi¬ 
date’s  career  path.  If  a  course  is  critical  important  for  candidate’s  career  path  then 
it  has  value  of  1,  if  it  is  good  match  then  value  of  0.75,  if  it  is  poor  match  then  value 
of  0.2,  and  if  there  is  no  match  then  value  of  0. 
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Appendix  B.  MATLAB  Code 


Here  is  the  MATLAB  code  for  solving  general  LP  problem  by  Jonker-Volgenant 
Algorithm  (Cao,  2011). 

function  [matches, value, v,u, weight]  =  my_lapj v (weight , resolution) 
if  nargin<2 

resolution=eps (max (max (weight) ) ) ; 

end 

[rdim,cdim]  =  size (weight) ; 

M=min (min (weight) ) ; 
if  rdim>cdim 

weight  =  weight’; 

[rdim,cdim]  =  size(weight) ; 
swapf =true ; 

else 

swapf =f alse ; 

end 

dim=cdim; 

weight  =  [weight ; 2*M+zeros (cdim-rdim, cdim)] ; 
weight (weight~=weight)=Inf ; 
maxvalue=max (weight (weight<Inf ) ) *dim+l ; 
if  isempty (maxvalue) 
maxvalue  =  Inf ; 
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end 


weight (weight==Inf ) =raaxvalue ; 
v  =  zeros(l,dim) ; 
matches  =  zeros (1, dim) -1; 
colsol  =  zeros (dim, 1)-1 ; 
if  std (weight (:) )  <  mean (weight (:) ) 
numfree=0; 

free  =  zeros (dim, 1) ; 
matches  =  zeros (dim, 1) ; 
for  j=dim: -1 : 1 

[v(j),  imin]  =  min (weight (: ,j )) ; 
if  "matches (imin) 
matches (imin) =j ; 
colsol ( j )=imin; 
elseif  v( j ) <v(matches (imin) ) 
jl=matches(imin) ; 
matches (imin) =j ; 
colsol (j)=imin; 
colsol ( j 1 ) =— 1 ; 

else 

colsol ( j )=-l ; 

end 
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matches (imin)=matches(irain)+l ; 


end 

for  i=l:dim 

if  "matches (i) 

numf ree=numf ree+1 ; 
free (numf ree) =i ; 

else 

if  matches (i)  ==  1 
j 1  =  matches (i) ; 
x  =  weight (i, : ) — v ; 
x(jl)  =  maxvalue; 
v ( j 1 )  =  v ( j 1 )  -  min(x) ; 

end 

end 

end 

else 

numf ree=dim-l ; 

[vl  r] =min(weight) ; 
free=l : dim; 

[~ , c] =min(vl) ; 
imin=r (c) ; 
j=c; 
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matches (imin)=j ; 
colsol ( j )=imin; 

%  matches (imin)=l; 
free(imin)  =  []  ; 
x  =  weight (imin, :) -v; 
x(j)  =  maxvalue; 
v(j)  =  v(j)  -  min(x) ; 

end 

loopcnt  =  0; 

while  loopcnt  <  2 

loopcnt  =  loopcnt  +  1 ; 
k  =  0; 

prvnumfree  =  numfree; 
numfree  =  0; 
while  k  <  prvnumfree 
k  =  k+1; 
i  =  free (k) ; 
x  =  weight (i , : )  -  v; 
[umin,  jl]  =  min(x)  ; 
x(jl)  =  maxvalue; 
[usubmin,  j2]  =  min(x) ; 
iO  =  colsolCj 1) ; 
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if  usubmin  -  umin  >  resolution 


v(jl)  =  v(jl)  -  (usubmin  -  umin); 

else 

if  iO  >  0 

jl  =  J 2 ; 

iO  =  colsol(j2) ; 

end 

end 

matches (i)  =  jl; 
colsol(jl)  =  i; 
if  iO  >  0 

if  usubmin  -  umin  >  resolution 
free(k)=iO; 
k=k-l ; 

else 

numfree  =  numfree  +  1; 
free(numfree)  =  iO; 

end 

end 

end 

end 

for  f=l: numfree 
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freerow  =  free(f); 


d  =  weight (freerow, : )  -  v; 
pred  =  freerow(l , ones (1 , dim) ) ; 
collist  =  l:dim; 
low  =  1; 
up  =  1; 

unassignedf ound  =  false; 
while  "unassignedf ound 
if  up  ==  low 

last  =  low-1; 

minh  =  d(collist (up) ) ; 

up  =  up  +  1 ; 

for  k=up:dim 

j  =  collist (k) ; 
h  =  d(j) ; 
if  h<=minh 

if  h<minh 

up  =  low; 
minh  =  h; 

end 

collist (k)  =  collist (up); 
collist (up)  =  j; 
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up  =  up  + 1 ; 


end 

end 

for  k=low:up-l 

if  colsol (collist  GO )  <  0 
endofpath  =  collist (k); 
unassignedf ound  =  true; 
break 

end 

end 

end 

if  ~unassignedf ound 
j 1  =  collist (low) ; 
low=low+l ; 
i  =  colsol(jl) ; 
x  =  weight (i , : ) -v; 
h  =  x(jl)  -  minh; 
xh  =  x-h; 
k=up : dim; 
j=collist (k) ; 
vfO  =  xh<d; 
vf  =  vfO(j) ; 


73 


Vj  =  j  (vf) ; 

vk  =  k(vf) ; 

pred(vj )=i ; 

v2  =  xh(vj ) ; 

d(vj)=v2; 

vf  =  v2  ==  minh; 

j  2  =  vj  (vf ) ; 

k2  =  vk(vf ) ; 

cf  =  colsol(j2)<0; 

if  any(cf) 

i2  =  f ind(cf , 1) ; 
endofpath  =  j  2 ( 12) ; 
unassignedf ound  =  true; 

else 

i2  =  nurael(cf)+l; 

end 

for  k=l:i2-l 

collist(k2(k))  =  collist(up); 
collist(up)  =  j2(k); 
up  =  up  +  1 ; 

end 

end 
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end 


j l=collist (1 : last+1) ; 
v(jl)  =  v(jl)  +  d(jl)  -  minh; 
while  1 

i=pred(endofpath) ; 
colsol (endof path) =i ; 
j l=endofpath; 
endofpath=matches (i) ; 
matches (i)=j 1 ; 
if  (i==freerow) 
break 

end 

end 

end 

matches  =  matches (1 : rdim) ; 
u=diag(weight ( : , matches) ) -v(matches) 5 ; 
u=u(l : rdim) ; 
v=v(l : cdim) ; 

value  =  sum (u)+sum(v (matches)) ; 
weight=weight ( 1 : rdim , 1 : cdim) ; 

weight  =  weight  -  u( ones (1 , cdim) )  -  v(ones (rdim, 1) , : ) ; 
if  swapf 
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weight  =  weight’; 


t=u’  ; 
u=v’  ; 
v=t ; 

end 

if  value>raaxvalue 
value=Inf ; 

end 

The  following  code  is  used  for  solving  Sub-problem(l). 

W=[];  %(We  use  our  assignment  matrix  as  Matrix  W.) 
A=[]  ; 

for  i=l:50 

for  j=l : 20 

if  W(i, j)==0 
A(i, j)=0; 

else 

A(i, j)=l; 

end 

end 

end 

weight=-l*A; 

[matches, value, v,u, weight]  =  my_lapjv(weight) ; 
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F=D  ; 


for  j=l : 20 

F(1 , j )=  W (matches (1 , j) , j) ; 

end 

result=sum(sum(F) ) ; 

Assignments  =  matches'; 

The  following  code  is  used  for  solving  Sub-problem (2). 

W=[];  %(We  use  our  assignment  matrix  as  Matrix  W.) 
weight=-l*W; 

[matches , value ,v,u, weight]  =  my_lapjv(weight) ; 
Max_Value  =  -l*value; 

Assignments  =  matches'; 
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Appendix  C.  Blue  Dart 


Multi  Criteria  Decision  Support  Model  for  the  Turkish  Air  Force 
Course/Education  Planning  System 

Personnel  education  is  one  of  the  most  important  subsystems  of  the  human 
resource  management  system  for  both  governmental  and  non-governmental  organiza¬ 
tions.  Despite  the  changes  of  the  war  environment  and  the  national  security  concept, 
the  military  is  still  so  important  for  all  countries.  Therefore,  Air  Forces  has  to  be 
organized  with  well  educated  personnel  as  all  other  services.  Moreover,  Air  Forces 
have  limited  budgets  and  effective  allocation  of  resources  is  always  desired. 

Personnel  course/education  planning  process  is  managed  by  a  department  be¬ 
neath  the  Personnel  Directorate  in  the  Turkish  Air  Force  (TURAF)  Headquarters 
and  the  education  is  separated  into  two  sections  in  this  department,  in  country  and 
abroad.  This  daunting  process  requires  a  great  deal  of  time  and  does  not  currently 
seek  to  find  an  optimal  solution. 

The  TURAF  is  formed  by  different  classes  of  personnel  (e.g.  officers,  NCOs, 
civilians,  specialists,  etc.)  and  each  class  has  different  career  paths  and  course/educa¬ 
tion  planning  systems.  Most  organizations  focus  on  strategic  level  personnel  education 
more  than  the  others,  because  the  variation  of  this  level  of  personnel  can  affect  the 
whole  organization.  Therefore  this  research  focuses  on  the  officer’s  course/education 
planning  system.  The  TURAF  has  a  database  for  all  personnel  information,  but  the 
officials  use  just  a  few  quantitative  personnel  data  points  to  complete  their  tasks. 
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Moreover,  the  matching  process  is  done  by  hand.  Therefore  there  is  a  need  for  a 
model,  which  supports  the  Decision  Makers  (DM),  to  cover  the  some  of  the  other 
quantitative  data  points  and  also  add  some  qualitative  data  for  better  decisions. 

In  this  research,  a  value  model  for  course/education  assignments  is  developed. 
The  multi  criteria  decision  analysis  method,  Value  Focused  Thinking  using  the  An¬ 
alytic  Hierarchy  Process  to  determine  value  weights,  is  used  to  develop  the  model; 
and  the  Jonker-Volgenant  Algorithm  for  linear  assignment  problems  is  used  for  the 
optimization  phase  of  the  problem.  To  take  into  consideration  the  cost,  benefit/cost 
ratios  are  used  in  an  assignment  matrix.  The  use  of  the  model  is  demonstrated  by  an 
example  and  the  robustness  of  the  model  is  tested  by  post  optimality  analysis. 

The  value  model  in  this  research  reflects  the  main  concerns  of  both  TURAF 
instructions  and  subject  matter  of  experts.  The  proposed  solution  methodology  finds 
the  maximum  number  of  matches  and  maximum  weighted  value.  Post  optimality 
analysis  shows  the  optimal  solution  is  achieved  in  a  reasonably  short  time  while  the 
current  system  takes  weeks  for  assignments  and  it  also  does  not  look  for  optimality. 

Because  of  the  complexity  of  human  resource  management,  sometimes  optimiza¬ 
tion  based  models  may  not  have  the  operational  feasibility.  The  military  environment 
makes  this  problem  more  complicated  due  to  its  own  rules.  Therefore,  flexibility  in 
the  solution  and  model  are  needed  and  graphical  user  interface  for  the  DMs  can  be 
created  to  enhance  this  flexibility.  To  use  the  proposed  model  effectively,  the  Air  Force 
has  to  have  databases  for  providing  necessary  data  for  both  personnel  and  courses.  To 
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improve  the  effectiveness  of  both  manpower  and  budget  utilizations  within  the  whole 
organization  needs  to  be  considered.  To  aid  in  seeing  the  big  picture  and  provide  bet¬ 
ter  utilization  for  the  Air  Force,  all  the  assignments  must  be  done  at  the  same  time 
instead  of  course  by  course  matching.  Although  this  methodology  finds  an  optimal 
solution,  it  is  still  going  to  be  an  initial  unless  the  whole  model  and  solution  method¬ 
ology  are  imported  to  the  related  TURAF  instructions.  However,  using  this  model 
and  solution  methodology  is  going  to  remarkably  decrease  the  workload  of  officials. 
Also,  this  kind  of  detailed  model  can  make  the  selection  process  more  objective  and 
reliable  which  may  result  with  better  personnel  morale  and  motivation. 

As  a  conclusion,  this  research  provides  a  good  decision  support,  which  combines 
qualitative  and  quantitative  data  together,  for  TURAF  personnel  -  course/education 
assignment  problem. 
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Appendix  D.  Storyboard 
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14.  ABSTRACT 

Many  personnel  are  assigned  to  different  courses  and  educational  opportunities  in  the  Turkish  Air  Force  every  year.  This  daunting  process 
requires  a  great  deal  of  time  and  does  not  currently  seek  to  find  an  optimal  solution.  The  Turkish  Air  Force  has  a  database  for  all  personnel 
information,  but  the  officials  use  just  a  few  quantitative  personnel  data  points  to  complete  their  tasks.  Moreover,  the  matching  process  is  done  by 
hand.  Therefore  there  is  a  need  for  a  model,  which  supports  the  Decision  Makers,  to  cover  the  some  of  the  other  quantitative  data  points  and  also  add 
some  qualitative  data  for  better  decisions. 

In  this  research,  a  value  model  for  course/education  assignments  is  developed.  The  multi  criteria  decision  analysis  method,  Value  Focused 
Thinking  using  the  Analytic  Hierarchy  Process  to  determine  value  weights,  is  used  to  develop  the  model;  and  the  Jonker-Volgenant  Algorithm  for 
linear  assignment  problems  is  used  for  the  optimization  phase  of  the  problem.  The  use  of  the  model  is  demonstrated  by  an  example  and  the 
robustness  of  the  model  is  tested  by  post  optimality  analysis. 
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